Method of providing screen for manipulating execution of application of image forming apparatus and image forming apparatus using the method

ABSTRACT

A method of providing a screen for manipulating execution of an application of an image forming apparatus, and the image forming apparatus using the method. The method includes an operation of displaying, on the screen, a first user interface for setting options to be applied to the execution of the application, and a second user interface including at least one virtual button for controlling the operation of the image forming apparatus, so that a user may control the image forming apparatus without using physical buttons.

CROSS-REFERENCE TO RELATED APPLICATIONS

This application claims the benefit of Korean Patent Application No.10-2014-0067796, filed on Jun. 3, 2014, in the Korean IntellectualProperty Office, the disclosure of which is incorporated herein in itsentirety by reference.

BACKGROUND

1. Field

One or more exemplary embodiments relate to a method of providing ascreen for manipulating execution of an application of an image formingapparatus, and the image forming apparatus using the method.

2. Description of the Related Art

Various image forming apparatuses including a printer, a copy machine, amulti-functional device, etc. have a user interface by which a user maycontrol an operation of the image forming apparatus or may input data tothe image forming apparatus. A screen that provides the user interfaceis displayed on a manipulation panel of the image forming apparatus.According to developments in various technologies, hardware and softwarethat are used in the image forming apparatus are also improved, andthus, the user interface of the image forming apparatus is beingimproved to increase user convenience.

SUMMARY

One or more exemplary embodiments include a method of providing a screenfor manipulating execution of an application of an image formingapparatus, and the image forming apparatus using the method, whereby theimage forming apparatus may be controlled by substituting a physicalbutton for a virtual button.

Additional aspects will be set forth in part in the description whichfollows and, in part, will be apparent from the description, or may belearned by practice of the presented exemplary embodiments.

According to one or more exemplary embodiments, a method of providing ascreen for manipulating execution of an application of an image formingapparatus includes operations of generating a first image signalindicating a first user interface for setting options to be applied tothe execution of the application, and a second image signal indicating asecond user interface including at least one virtual button forcontrolling an operation of the image forming apparatus; and displaying,based on the first image signal and the second image signal, the firstuser interface and the second user interface on the screen.

According to one or more exemplary embodiments, a non-transitorycomputer-readable recording medium includes a recorded program forexecuting the method by using a computer.

According to one or more exemplary embodiments, an image formingapparatus that provides a screen for manipulating execution of anapplication includes an image processor for generating a first imagesignal indicating a first user interface for setting options to beapplied to the execution of the application, and a second image signalindicating a second user interface including at least one virtual buttonfor controlling an operation of the image forming apparatus; and adisplay for displaying, based on the first image signal and the secondimage signal, the first user interface and the second user interface onthe screen.

According to one or more exemplary embodiments, an image formingapparatus that provides a screen for manipulating execution of anapplication includes an image forming unit, an image processor togenerate a first user interface for setting options to be applied to theexecution of the application and a second user interface comprisingfirst and second virtual buttons for controlling an operation of theimage forming apparatus, and a display to display the first userinterface and the second user interface on the screen. At least one of afunction and an appearance of the first virtual button is maintainedidentical regardless of the application whose options are set by thefirst user interface while at least one of a function and an appearanceof the second virtual button is changed according to the applicationwhose options are set by the first user interface.

BRIEF DESCRIPTION OF THE DRAWINGS

These and/or other aspects will become apparent and more readilyappreciated from the following description of the exemplary embodiments,taken in conjunction with the accompanying drawings in which:

FIG. 1 illustrates an external appearance of an image forming apparatus;

FIG. 2 illustrates physical button keys included in a manipulation panelof an image forming apparatus according to the related art;

FIG. 3 is a block diagram illustrating a configuration of the imageforming apparatus, according to an exemplary embodiment;

FIG. 4 illustrates a screen for manipulating execution of an applicationof the image forming apparatus, according to an exemplary embodiment;

FIG. 5 illustrates the screen for manipulating execution of anapplication of the image forming apparatus, according to anotherexemplary embodiment;

FIG. 6 illustrates changes in a second user interface which occur when auser's manipulation with respect to a first user interface is input tothe screen for manipulating execution of an application of the imageforming apparatus, according to an exemplary embodiment;

FIG. 7 illustrates changes in the second user interface which occur whenthe user's manipulation with respect to the first user interface isinput to the screen for manipulating execution of an application of theimage forming apparatus, according to another exemplary embodiment;

FIG. 8 illustrates that a position of the second user interface is movedon the screen for manipulating execution of an application of the imageforming apparatus, according to an exemplary embodiment;

FIG. 9 illustrates that a position of the second user interface is movedon the screen for manipulating execution of an application of the imageforming apparatus, according to another exemplary embodiment;

FIG. 10 is a block diagram illustrating a configuration of the imageforming apparatus, according to another exemplary embodiment; and

FIG. 11 is a flowchart of a method of providing the screen formanipulating execution of an application of the image forming apparatus,according to an exemplary embodiment.

DETAILED DESCRIPTION

Reference will now be made in detail to exemplary embodiments, examplesof which are illustrated in the accompanying drawings. In this regard,the present exemplary embodiments should be considered in a descriptivesense only and not for purposes of limiting the scope of the inventiveconcept. All differences that can be easily derived, by one of ordinaryskill in the art, from the descriptions and the exemplary embodiments,will be construed as being included in the scope of the inventiveconcept.

Throughout the specification, it will be further understood that theterms “configured”, “configuring”, “formed”, and/or “forming” and“comprises”, “comprising,”, “includes” and/or “including”, when usedherein, specify the presence of stated components, steps, or operations,but do not preclude the absence of one or more of the components, steps,or operations or the addition of one or more other components, steps, oroperations.

While such terms as “first,” “second,” etc., may be used to describevarious components, such components must not be limited to the aboveterms. The above terms are used only to distinguish one component fromanother.

One or more exemplary embodiments are related to a method of providing ascreen for manipulating execution of an application of an image formingapparatus, and the image forming apparatus using the method. In thefollowing description, functions or constructions that are well-known toone of ordinary skill in the art will not be described in detail.

As used herein, the term “and/or” includes any and all combinations ofone or more of the associated listed items.

FIG. 1 illustrates an external appearance of an image forming apparatus100. The image forming apparatus 100 is an apparatus including aprinter, a copy machine, or a multi-functional device capable of formingan image on a transfer medium such as paper.

The image forming apparatus 100 may have a user interface devicearranged externally at a front portion, a side portion, or a rearportion of the image forming apparatus 100 so as to display informationfor controlling an operation of the image forming apparatus 100 and toreceive an input of a user's manipulation. The user interface device mayindicate both hardware and software that connect the image formingapparatus 100 with a user, and may be installed in the image formingapparatus 100. The user interface device may separately include adisplay for displaying information and a user input unit for receivingan input of the user's manipulation or may be configured such that atouchscreen in which the display and the user input unit are combined.

As illustrated in FIG. 1, the image forming apparatus 100 may provide ascreen 200 at the front portion of the external appearance so as tomanipulate an application of the image forming apparatus 100. The screen200 for manipulating the execution of the application may be displayedon a display of the image forming apparatus 100. In order to operate afunction of the image forming apparatus 100, a user may execute theapplication that corresponds to the function in the screen 200 formanipulating the application.

FIG. 2 illustrates physical button keys included in a manipulation panel300 of an image forming apparatus according to the related art.

Referring to FIG. 2, the manipulation panel 300 of the image formingapparatus according to the related art has a screen that displaysinformation to a user so as to control the image forming apparatus, anda keypad 310 that is configured of the physical button keys as a userinput unit for receiving an input of the user's manipulation. The keypad310 that is configured of the physical button keys includes a 3×4 matrixnumbers button part, a function button part, a control button part, alight-emitting diode (LED) for notifying a user about a status of theimage forming apparatus, or the like. Here, the term “physical button”may refer to a button that protrudes from the manipulation panel andthat has a tangible shape of its own such as a key on a computerkeyboard, or a raised bubble key on a membrane-type keypad.

However, recently, a size of a manipulation panel mounted in the imageforming apparatus 100 has increased, and in particular, a ratio hasincreased by which a display panel for displaying information to a user,a touch panel for receiving information from the user, or a touchscreenthat combines the display panel and the touch panel occupies the overallmanipulation panel.

When a size of the touch panel that is an integrated module of thedisplay panel and the touch panel is increased, the user mayspecifically manipulate various functions that are executable in theimage forming apparatus 100, so that user convenience with respect tothe image forming apparatus 100 may be increased. Hereinafter, in one ormore exemplary embodiments, physical keys that were provided in therelated art as physical buttons of a manipulation panel of the imageforming apparatus 100 are removed and, instead, the physical keys aregenerated as virtual buttons or icons by using software and are providedwith the screen 200 for manipulating execution of an application.Accordingly, user convenience and usability of the image formingapparatus 100 may be highly improved. Hereinafter, a method of providingthe screen 200 for manipulating execution of an application of the imageforming apparatus 100, and the image forming apparatus 100 using themethod are described.

FIG. 3 is a block diagram illustrating a configuration of the imageforming apparatus 100, according to an exemplary embodiment. It will beobvious to one of ordinary skill in the art that the image formingapparatus 100 may further include general-use elements as well as theelements shown in FIG. 3.

Referring to FIG. 3, the image forming apparatus 100 may include adisplay 110 and an image processor 130.

The display 110 may include a display panel (not shown) and a controller(not shown) for controlling the display panel. The display panel may beembodied as various displays including a liquid crystal display (LCD),an organic light-emitting diode (OLED) display, an active-matrix organiclight-emitting diode (AM-OLED) display, a plasma display panel (PDP), orthe like. The display 110 may be combined with a touch panel (not shown)and thus may be provided as a touchscreen (not shown). For example, thetouchscreen may include an integrated module formed by stacking thedisplay panel and the touch panel.

The image processor 130 may process an image signal for generating ascreen to be displayed on the display 110. When a booting process of theimage forming apparatus 100 is complete, the image processor 130 maygenerate a screen by processing an image signal so as to display ascreen for controlling an operation of the image forming apparatus 100.In more detail, the image processor 130 may generate a screen includingvarious objects such as various applications for executing functions ofthe image forming apparatus 100, various user interfaces for receivingan input of user's manipulation, various contents for providinginformation to a user. Examples of a user's manipulation may includetouching a particular icon or virtual button with a finger or stylus.Different touches such as touches varying with time, location, orpressure may yield varying results. The image processor 130 maycalculate attribute values such as coordinates values, forms, sizes, orcolors by which the objects are displayed according to layouts ofscreens. Then, the image processor 130 may generate, based on theattribute values, the screens that have various layouts and include theobjects.

The screens generated by the image processor 130 may be provided to thedisplay 110 and may be displayed on an entire area or variouspredetermined areas making up a portion of the display 110.

Hereinafter, mutual connection between the display 110 and the imageprocessor 130, and operations of the display 110 and the image processor130 shown in FIG. 3 are described.

The image processor 130 may generate an image signal that indicates afirst user interface for setting options to be applied to execution ofan application, and a second user interface including at least onevirtual button for controlling an operation of the image formingapparatus 100 so that the first and second user interfaces aregenerated.

The display 110 may display, based on the image signal generated by theimage processor 130, the first user interface and the second userinterface on the screen 200 for manipulating the execution of theapplication.

When the user's manipulation with respect to the screen 200 is input,the image processor 130 may perform image processing that corresponds tothe user's manipulation and may control a new screen to be displayed onthe display 110. Hereinafter, a configuration and operations of thescreen 200 for manipulating execution of an application are 3 describedin detail.

FIG. 4 illustrates the screen 200 for manipulating execution of anapplication of the image forming apparatus 100, according to anexemplary embodiment. FIG. 4 illustrates the screen 200 for manipulatingthe execution of the application when a user selects a copy applicationfrom among a plurality of applications that are executable by the imageforming apparatus 100.

Referring to FIG. 4, the screen 200 for manipulating the execution ofthe application may include a first user interface 210 for settingoptions to be applied to the execution of the application, and a seconduser interface 220 including at least one virtual button (here, virtualbuttons 222 and 224) for controlling an operation of the image formingapparatus 100.

The first user interface 210 may set the options to be applied to theexecution of the application. As illustrated in FIG. 4, when the copyapplication is executed, the first user interface 210 may set optionsrelated to a copy, e.g., the number of copied pages, image attributeadjustment, a paper source, reduction/enlargement, a duplex copy, acolor mode, document alignment, etc.

The second user interface 220 may include the virtual buttons 222 and224 for controlling the operation of the image forming apparatus 100.The virtual button 222 may be one of buttons for starting, stopping, andresetting the operation of the image forming apparatus 100. The seconduser interface 220 may also include the virtual button 224 whose shapeand function are changed according to types of the application. Forexample, referring to FIGS. 4 and 5, respectively, button 224 isconfigured as an Interrupt function when the Copy application is beingexecuted or is being displayed in first user interface 210 while button224 is configured as an On Hook function when the Start application isbeing executed or is being displayed in first user interface 210. Whenthe second user interface 220 includes the virtual buttons 222 and 224,the second user interface 220 may be separated based on each of thevirtual buttons 222 and 224 and may be displayed.

The first user interface 210 and the second user interface 220 mayoccupy separate areas of the screen 200 without overlapping each otheror may be displayed while overlapping each other. In order to utilizewell an area of the screen 200 for manipulating the execution of theapplication, it is recommended that the first user interface 210 and thesecond user interface 220 are displayed while overlapping each other,and the second user interface 220 adaptively varies according to user'smanipulation. Hereinafter, for convenience of description, it is assumedthat the first user interface 210 and the second user interface 220overlap each other on the screen 200 for manipulating the execution ofthe application.

When the first user interface 210 and the second user interface 220overlap each other on the screen 200 for manipulating the execution ofthe application, the second user interface 220 may be displayed on oroverlapping the first user interface 210. In other words, an area of thefirst user interface 210 that is overlapped by the second user interface220 including the virtual buttons 222 and 224 may be obstructed by thesecond user interface 220. In this case, in order to minimize theobstruction due to the second user interface 220, a transparency of anentire area or a partial area of the second user interface 220 may beadjusted. For example, a degree of the transparency of the entire areaor the partial area of the second user interface 220 may be greater thana degree of a transparency of the first user interface 210.

The first user interface 210 and the second user interface 220 may bedisplayed differently according to application types. Hereinafter, whena different application is executed, the screen 200 for manipulatingexecution of the different application is described.

FIG. 5 illustrates the screen 200 for manipulating execution of anapplication of the image forming apparatus 100, according to anotherexemplary embodiment. FIG. 5 illustrates the screen 200 for manipulatingthe execution of the application when a user selects a send applicationfrom among a plurality of applications that are executable by the imageforming apparatus 100. The embodiment of FIG. 5 is described withreference to a difference from the embodiment of FIG. 4.

Referring to FIG. 5, the screen 200 for manipulating the execution ofthe application may include a first user interface 210 for settingoptions to be applied to the execution of the application, and a seconduser interface 220 including the virtual buttons 222 and 224 forcontrolling an operation of the image forming apparatus 100.

The first user interface 210 may set the options to be applied to theexecution of the application. As illustrated in FIG. 5, when the sendapplication is executed, the first user interface 210 may set optionsrelated to scanning and transmitting a document, e.g., the optionsrelated to adjusting an attribute of an image included in the document,setting a sender, setting a receiver, a method of transmitting thescanned document, scanning both sides, skipping a blank page, a filename of the scanned document, a file format of the scanned document,resolution of the scanned document, etc.

The second user interface 220 may include virtual buttons 222 and 224for controlling the operation of the image forming apparatus 100. As inthe embodiment of FIG. 4, the virtual button 222 may be one of buttonsfor starting, stopping, and resetting the operation of the image formingapparatus 100. However, unlike the embodiment of FIG. 4, when the sendapplication is executed or when attributes corresponding to the sendapplication are displayed on the first user interface 210, the seconduser interface 220 may include an On Hook button as the virtual button224 whose shape and function are changed according to types of theapplication. In the embodiment of FIG. 4, when the copy application isexecuted, the virtual button 224 whose shape and function are changedaccording to types of the application is an Interrupt button.

Hereinafter, as in the embodiments of FIGS. 4 and 5, when the first userinterface 210 and the second user interface 220 overlap each other onthe screen 200 for manipulating execution of an application, changes inthe screen 200 for manipulating the execution of the application isdescribed, wherein the changes occur in response to an input of user'smanipulation.

FIG. 6 illustrates changes in a second user interface 220 which occurwhen user's manipulation with respect to a first user interface 210 isinput to the screen 200 for manipulating execution of an application ofthe image forming apparatus 100, according to an exemplary embodiment.Referring to FIG. 6, three diagrams are shown from the left, accordingto flow of time, and in particular, an area of the first user interface210 that overlaps the second user interface 220 is mainly shown.

Referring to the first diagram, when the first user interface 210 andthe second user interface 220 overlap each other on the screen 200 formanipulating the execution of the application, the second user interface220 may be displayed on the first user interface 210. Thus, a user hasno difficulty in pressing virtual buttons 222 and 224 and executingfunctions of the virtual buttons 222 and 224 that are included in thesecond user interface 220.0 However, an area of the first user interface210 that is obstructed by the second user interface 220 is not apparentor clearly visible and thus is unable to receive an input of user'smanipulation. Here, as shown in the first diagram, a user may inputuser's manipulation to a random area of the first user interface 210.

Referring to the second diagram, after the user's manipulation withrespect to the first user interface 210 is input, the second userinterface 220 becomes transparent.

Referring to the third diagram, the second user interface 220 completelydisappears on the first user interface 210. Here, the user maypreviously set and adjust a time in which the second user interface 220becomes transparent and then completely disappears.

As described above, when the user's manipulation with respect to thefirst user interface 210 is input, the second user interface 220disappears during a predetermined time from the screen 200 formanipulating the execution of the application, so that the first userinterface 210 may be in a usable state for the user.

If the user's manipulation is not input during the predetermined time,the display 110 of the image forming apparatus 100 may display again thesecond user interface 220 on the first user interface 210.Alternatively, if user's manipulation is input to request the display110 to display the second user interface 220, the display 110 of theimage forming apparatus 100 may display again the second user interface220 on the first user interface 210. A procedure in which thedisappeared second user interface 220 is displayed again on the screen200 for manipulating the execution of the application may be in reverseorder of the diagrams shown in FIG. 6.

FIG. 7 illustrates changes in the second user interface 220 which occurwhen a user's manipulation with respect to the first user interface 210is input to the screen 200 for manipulating execution of an applicationof the image forming apparatus 100, according to another exemplaryembodiment. Referring to FIG. 7, three diagrams are shown from left toright, according to the flow of time, and in particular, an area of thefirst user interface 210 that overlaps the second user interface 220 ismainly shown.

Referring to the first diagram, when the first user interface 210 andthe second user interface 220 overlap each other on the screen 200 formanipulating the execution of the application, the second user interface220 may be displayed over the first user interface 210. As describedabove with respect to FIG. 6, an area of the first user interface 210that is obstructed by the second user interface 220 is not apparent orclearly visible and thus is unable to receive an input of user'smanipulation. Here, as shown in the first diagram, the user'smanipulation may be input to arbitrarily input to any area of the firstuser interface 210.

Referring to the second diagram, after the user's manipulation withrespect to the first user interface 210 is input, the second userinterface 220 moves in a right direction. In this regard, the user maypreviously set and adjust a disappearance speed, a disappearancedirection, or a disappearance position of the second user interface 220.In the second diagram, an area 230 of the second user interface 220 thathas a dotted outline extends beyond the screen 200 for manipulating theexecution of the application, and thus is not displayed on the screen200 for manipulating the execution of the application.

Referring to the third diagram, the second user interface 220 may bedisplayed in the form of a substitution icon 240 on an area of thescreen 200 for manipulating the execution of the application, so as tonotify the user about the existence of the second user interface 220.The substitution icon 240 may be generated by deforming an area of thesecond user interface 220 or may be generated with a new form.Alternatively, as illustrated in FIG. 6, the second user interface 220may completely disappear on the first user interface 210.

As described above, when the user's manipulation with respect to thefirst user interface 210 is input, the second user interface 220 issubstituted or replaced with the substitution icon 240 having a smallsize or completely disappears for a predetermined time from the screen200 for manipulating the execution of the application, so that the firstuser interface 210 may be in a usable state for the user. In analternative embodiment, the second user interface 220 disappears untilthe user's manipulation with respect to the first user interface is nolonger input.

If the user's manipulation is not input during the predetermined time,the display 110 of the image forming apparatus 100 may display again thesecond user interface 220 on the first user interface 210.Alternatively, if user's manipulation is input to request the display110 to display the second user interface 220, e.g., if the user clicksthe substitution icon 240, the display 110 of the image formingapparatus 100 may display again the second user interface 220 on thefirst user interface 210. A procedure in which the disappeared seconduser interface 220 is displayed again on the screen 200 for manipulatingthe execution of the application may be in reverse order of the diagramsshown in FIG. 7.

As described above with reference to FIGS. 6 and 7, in a case where thefirst user interface 210 and the second user interface 220 are displayedwhile overlapping each other and thus, it is difficult to use the firstuser interface 210, the second user interface 220 may disappearaccording to the user's manipulation, so that the user may use the firstuser interface 210.

FIG. 8 illustrates that a position of the second user interface 220 ismoved on the screen 200 for manipulating execution of an application ofthe image forming apparatus 100, according to an exemplary embodiment.

If the position of the second user interface 220 displayed on the screen200 for manipulating the execution of the application obstructs aportion, required to be viewed, of the first user interface 210, it isnecessary to change the position of the second user interface 220 thatoverlaps on the first user interface 210.

Referring to FIG. 8, the second user interface 220 that is displayedover the first user interface 210 and that obscures a portion of thefirst user interface 210 may be moved to an arbitrary or random positionon the first user interface 210, according to user's manipulation.

For example, as illustrated in FIG. 8, if a user presses a portion ofthe second user interface 220 for few seconds at an original position ofthe second user interface 220, the second user interface 220 may be in amovable state for the user. Afterward, the user may move the second userinterface 220 to a desired position in a drag-and-drop manner, so thatthe original position of the second user interface 220 may be changed.An alternative method of moving the original position of the second userinterface 220 is described below with reference to FIG. 9.

FIG. 9 illustrates that a position of the second user interface 220 ismoved on the screen 200 for manipulating execution of an application ofthe image forming apparatus 100, according to another exemplaryembodiment.

As illustrated in FIG. 9, if user's manipulation with respect to thesecond user interface 220 is input, the display 110 of the image formingapparatus 100 may display positions 250 to which the second userinterface 220 may be moved on the screen 200 for manipulating theexecution of the application. For example, if a user presses a portionof the second user interface 220 for few seconds, the display 110 maydistinguishably display the positions 250 from other areas of the firstuser interface 210.

The display 110 of the image forming apparatus 100 may move and displaythe second user interface 220 at a user-selected position from among thepositions 250 to which the second user interface 220 may be moved. Forexample, if the user selects one of the positions 250 to which thesecond user interface 220 may be moved, or drags and drops the seconduser interface 220 to a desired position, the display 110 of the imageforming apparatus 100 may move and display the second user interface220.

FIG. 10 is a block diagram illustrating a configuration of the imageforming apparatus 100, according to another exemplary embodiment. Itwill be obvious to one of ordinary skill in the art that the imageforming apparatus 100 may further include general-use elements as wellas the elements shown in FIG. 10. Elements of the image formingapparatus 100 may be added, omitted, or integrated according to actualspecification of the image forming apparatus 100. For example, ifrequired, at least two elements from among the elements of the imageforming apparatus 100 shown in FIG. 10 may be integrated into oneelement or one element from among the elements may be subdivided into atleast two elements.

Referring to FIG. 10, the image forming apparatus 100 may include, forexample, the display 110, a user input unit 120, the image processor130, a memory 140, a fax 150, a scanner 160, an image forming unit 170,a communication unit 180, and a controller 190. The elements mayexchange data with each other by using a data bus 195.

The display 110 may display, to a user, the screen 200 for manipulatingexecution of an application. The screen 200 for manipulating theexecution of the application may include a first user interface 210 forsetting options to be applied to the execution of the application, and asecond user interface 220 including virtual buttons 222 and 224 forcontrolling an operation of the image forming apparatus 100.

The image processor 130 may generate a first image signal and a secondimage signal that indicate, respectively, the first user interface 210and the second user interface 220 that are to be displayed on the screen200 for manipulating the execution of the application. The first andsecond image signals that are generated by the image processor 130 maybe transmitted to the display 110 and thus may be displayed as imagesincluding the first user interface 210 and the second user interface 230on the screen 200 for manipulating the execution of the application.Also, the image processor 130 may process, based on user's manipulationinput to the user input unit 120, image signals so as to newly compose ascreen displayed on the display 110. The image processing and the layoutof the screen that are performed by the image processor 130 according tothe user's manipulation are described above with reference to FIGS. 4through 9.

Regarding the display 110 and the image processor 130, descriptions thatare the same as the aforementioned contents will be omitted here.

The user input unit 120 may receive, from a user, an input of user'smanipulation with respect to a screen that is displayed on the display110. The user input unit 120 may include at least one selected from atouch panel and a pen recognizing panel.

The touch panel may sense a touch input by a user and may output a valueof a touch event that corresponds to a signal generated by the sensedtouch input. When the touch panel is combined with a display panel andthus is formed as a touchscreen, the touchscreen may be configured as acapacitive touchscreen or a resistive touchscreen by using various typesof touch sensors. The capacitive touchscreen may calculate touchcoordinates by sensing a small amount of electricity generated when abody part of the user touches the surface of the capacitive touchscreen,which is coated with a dielectric material. The resistive touchscreenmay include two embedded electrode plates and may calculate touchcoordinates by sensing a flow of current that occurs when the usertouches the resistive touchscreen and thus upper and lower plates of atouched point contact each other. The touch event that occurs on thetouchscreen may be mainly generated by a finger of a person but may alsobe generated by an object formed of a conductive material capable ofchanging capacitance.

The pen recognizing panel may sense a proximate input or a touch inputof a touch pen (e.g., a stylus pen or a digitizer pen) which occurs by auser, and may output a sensed proximate pen event or a sensed pen touchevent. The pen recognizing panel may sense the touch input or theproximate input according to changes in a strength of an electromagneticfield, which occur when the touch pen approaches or touches the penrecognizing panel.

The memory 140 may store all pieces of data that are generated accordingto an operation of the image forming apparatus 100 and may store allprograms that are used when the image forming apparatus 100 operates.For example, the memory 140 may store data such as data received from anexternal device, data input via the user input unit 120, faxed data,scanned data, and copied data that are generated according to theoperation of the image forming apparatus 100, and may store variousprograms that are used in controlling the image forming apparatus 100.Also, the memory 140 may temporarily or semi-permanently store a part ofcontent to be displayed on the screen of the display 110.

The memory 140 may include at least one selected from an internal memory(not shown) and an external memory (not shown). The internal memory mayinclude at least one selected from a volatile memory (e.g., a dynamicrandom-access memory (DRAM), a static RAM (SRAM), a synchronous dynamicRAM (SDRAM), etc.), a non-volatile memory (e.g., a one time programmableread-only memory (OTPROM), a programmable ROM (PROM), an erasable andprogrammable ROM (EPROM), an electrically erasable and programmable ROM(EEPROM), a mask ROM, a flash ROM, etc.), a hard disk drive (HDD), and asolid-state drive (SSD). The external memory may include at least oneselected from a compact flash (CF) memory, a secure digital (SD) memory,a micro secure digital (Micro-SD) memory, a mini secure digital (miniSD) memory, an extreme digital (xD) memory, and a memory stick.

The fax 150 transmits or receives fax data by using a modem. The fax 150may convert image data, which is recorded to a document, into fax datato be adaptive for transmission using the modem, or may receive fax datafrom an external device and may deliver the fax data to the imageforming unit 170 so as to control the image forming unit 170 to outputthe fax data to a printing medium such as a printing paper.

The scanner 160 may generate scanned data by scanning image data that isrecorded to a document, and may deliver the scanned data to thecommunication unit 180 for an access to a network, to the memory 140 forstorage, to the fax 150 for fax transmission, or to the image formingunit 170 for printing. That is, the scanner 160 may perform functionssuch as a scan to a server message block (scan to SMB) function, a scanto file transfer protocol (scan to FTP) function, a web distributedauthoring and versioning (a SCAN TO WebDAV) function, a scan to e-mailfunction, a scan to personal computer (PC) function, or a scan to boxfunction.

The image forming unit 170 forms an image and outputs copied and printeddata to a printing medium such as a printing paper. The image formingunit 170 may include hardware units and a software module for drivingthe hardware units that perform charging, exposing, developing,transferring, and fixing operations so as to output the copied andprinted data to the printing medium.

The communication unit 180 may include a network module for an access toa network according to an application and functions of the image formingapparatus 100, the modem for fax transmission and reception, and auniversal serial bus (USB) host module for establishing a data transferchannel with a portable storage medium. The communication unit 180 maycommunicate with various external devices according to variouscommunication schemes. The communication unit 180 may include at leastone selected from a WiFi chip, a Bluetooth chip, a wirelesscommunication chip, and a near field communication (NFC) chip. Thecontroller 190 may control the communication unit 180 to communicatewith the various external devices.

The WiFi chip and the Bluetooth chip may communicate with another deviceby using WiFi and Bluetooth, respectively. If the WiFi chip or theBluetooth chip is used, the WiFi chip or the Bluetooth chip may firsttransmit and receive various types of connection information including aservice set identification (SSID), a session key, or the like, mayconnection communication by using the connection information, and thenmay transmit and receive various types of information. The wirelesscommunication chip indicates a chip that communicates with anotherdevice according to various communication standards such as theInstitute of Electrical and Electronics Engineers (IEEE), ZigBee 3^(rd)generation (3G), 3rd Generation Partnership Project (3GPP), Long TermEvolution (LTE), or the like. The NFC chip indicates a chip thatoperates in an NFC way by using a 13.56 MHz band from among variousradio frequency-identification (RF-ID) frequency bands such as 135 kHz,13.56 MHz, 433 MHz, 860˜960 MHz, 2.45 GHz, or the like.

The controller 190 may generally control functions of the image formingapparatus 100 and may be formed as a micro-processor. The controller 190may be divided into a plurality of processor modules that are separatedaccording to their functions, and a main processor module thatcollectively manages the plurality of processor modules. The controller190 may control the display 110, the user input unit 120, and the imageprocessor 130 to display a screen including a user interface so that auser may watch, and to process image signals according to an input ofuser's manipulation so that a screen corresponding thereto may bedisplayed. Also, the controller 190 may control various programs anddata to be stored in the memory 140 or may control various programs anddata stored in the memory 140 to be loaded from the memory 140. Thecontroller 190 may control an operation of the fax 150 to transmit orreceive a fax or may control an operation of the scanner 160 to scan adocument. The controller 190 may control data loaded from the memory 140to be compared with data processed by the controller 190, or may controldata stored in the memory 140 to be delivered to the image forming unit170. The controller 190 may control the communication unit 180 toreceive data from an external device or to transmit data to the externaldevice.

Names of the elements of the image forming apparatus 100 may be changed.The image forming apparatus 100 may be embodied with more or lesselements than the aforementioned elements and may further include otherelements.

FIG. 11 is a flowchart of a method of providing the screen 200 formanipulating execution of an application of the image forming apparatus100, according to an exemplary embodiment. Although descriptions areomitted here, if the descriptions are described above, the descriptionsmay also be applied to the flowchart of FIG. 11.

In operation S1110, the image processor 130 of the image formingapparatus 100 may generate a first image signal that indicates the firstuser interface 210 for setting options to be applied to the execution ofthe application and may generate a second image signal that indicatesthe second user interface 220 including the virtual buttons 222 and 224for controlling an operation of the image forming apparatus 100. Thefirst user interface 210 and the second user interface 220 may bedifferently displayed according to application types.

The virtual button 222 may be one of a button for starting, stopping,and resetting the operation of the image forming apparatus 100. Thesecond user interface 220 may include the virtual button 224 whose shapeand function are changed according to types of the application. When thesecond user interface 220 includes the virtual buttons 222 and 224, thesecond user interface 220 may be separated based on each of the virtualbuttons 222 and 224 and may be displayed.

In operation S1120, the display 110 of the image forming apparatus 100may display, based on the first image signal and the second imagesignal, the first user interface 210 and the second user interface 220on the screen 200 for manipulating the execution of the application. Ifthe first user interface 210 and the second user interface 220 overlapeach other on the screen 200 for manipulating the execution of theapplication, the display 110 may display the second user interface 220over the first user interface 210. Here, a degree of a transparency ofan entire area or a partial area of the second user interface 220 may begreater than a degree of a transparency of the first user interface 210.By doing so, a user may see information, which is displayed on an areaof the first user interface 210 that is obstructed by the second userinterface 220, via the second user interface 220 that is translucent.Also, the user may move the second user interface 220 to a randomposition on the first user interface 210.

If user's manipulation occurs with respect to the screen 200 formanipulating the execution of the application that is displayed on thedisplay 110 of the image forming apparatus 100, the user's manipulationis input by using the user input unit 120. Based on the input user'smanipulation, the image processor 130 may newly compose the screen 200for manipulating the execution of the application that is to bedisplayed on the display 110.

For one example, in a case where the second user interface 220 that isplaced over the first user interface 210 is displayed on the screen 200for manipulating the execution of the application, if user'smanipulation with respect to the first user interface 210 is input, theimage forming apparatus 100 may control the second user interface 220 todisappear from the screen 200 during a predetermined time, and if theuser's manipulation is not input during the predetermined time, theimage forming apparatus 100 may control the second user interface 220 tobe displayed again. For another example, in a case where the second userinterface 220 that is placed over the first user interface 210 isdisplayed on the screen 200 for manipulating the execution of theapplication, if user's manipulation with respect to the first userinterface 210 is input, the image forming apparatus 100 may control thesecond user interface 220 to be displayed as a substitution icon on anarea of the screen 200 for manipulating the execution of theapplication, and if the user's manipulation with respect to thesubstitution icon is input, the image forming apparatus 100 may controlthe second user interface 220 to be displayed again.

As described above, according to the one or more of the above exemplaryembodiments, the image forming apparatus may be controlled in a mannerthat physical buttons are displayed as virtual buttons by usingsoftware, whereby usability of the image forming apparatus may beimproved.

The method of providing the screen for manipulating the execution of theapplication can be written as computer programs and can be implementedin general-use digital computers that execute the programs using anon-transitory computer readable recording medium. Examples of thecomputer readable recording medium include magnetic storage media (e.g.,ROM, floppy disks, hard disks, etc.), optical recording media (e.g.,CD-ROMs, or DVDs), etc.

Examples of program instructions include both machine code, such asproduced by a compiler, and files containing higher level code that maybe executed by the computer using an interpreter. The described hardwaredevices may be configured to act as one or more software modules inorder to perform the operations of the above-described embodiments, orvice versa. Any one or more of the software modules described herein maybe executed by a dedicated hardware-based computer or processor uniqueto that unit or by a hardware-based computer or processor common to oneor more of the modules. The described methods may be executed on ageneral purpose computer or processor or may be executed on a particularmachine such as the image forming apparatus described herein.

It should be understood that the exemplary embodiments described hereinshould be considered in a descriptive sense only and not for purposes oflimitation. Descriptions of features or aspects within each exemplaryembodiment should typically be considered as available for other similarfeatures or aspects in other exemplary embodiments.

While one or more exemplary embodiments have been described withreference to the figures, it will be understood by those of ordinaryskill in the art that various changes in form and details may be madetherein without departing from the spirit and scope as defined by thefollowing claims.

What is claimed is:
 1. A method of providing a screen for manipulatingexecution of an application of an image forming apparatus, the methodcomprising: generating a first image signal indicating a first userinterface for setting options to be applied to the execution of theapplication, and a second image signal indicating a second userinterface comprising at least a first virtual button for controlling anoperation of the image forming apparatus and a second virtual button forcontrolling another operation of the image forming apparatus, wherein atleast one of a function and an appearance of the first virtual button ismaintained identical regardless of the application whose options are setby the first user interface while at least one of a function and anappearance of the second virtual button is changed according to theapplication whose options are set by the first user interface; receivinga setting of a disappearance adjustment configuration for the seconduser interface; and displaying, based on the first image signal and thesecond image signal, the first user interface and the second userinterface on the screen, wherein the displaying of the second userinterface is at least partly based on the disappearance adjustmentconfiguration, wherein the setting of a disappearance adjustmentconfiguration includes a predetermined time, set by a user, in which thesecond user interface becomes transparent and then completely disappearsduring the predetermined time.
 2. The method of claim 1, wherein, if thefirst user interface and the second user interface overlap each other onthe screen, the displaying comprises displaying the second userinterface on the first user interface.
 3. The method of claim 2, whereina degree of transparency of an entire area or a partial area of thesecond user interface is greater than a degree of transparency of thefirst user interface so that a portion of an area of the first userinterface that is overlapped by the second user interface, is visible bythe difference between the degrees of transparencies of the first userinterface and the second user interface.
 4. The method of claim 2,wherein, if a manipulation by the user with respect to the first userinterface is input, the second user interface disappears from thescreen, and if the manipulation by the user with respect to the firstuser interface ends, the second user interface is displayed again on thescreen.
 5. The method of claim 2, wherein, if a manipulation by the userwith respect to the first user interface is input, the second userinterface is displayed as a substitution icon on an area of the screen,and if a manipulation by the user with respect to the substitution iconis input, the second user interface is displayed again on the screen. 6.The method of claim 2, wherein the second user interface can be moved toa random position on the first user interface.
 7. The method of claim 1,further comprising, when a manipulation by the user with respect to thesecond user interface occurs, displaying positions to where the seconduser interface can be moved on the screen; and moving the second userinterface to a position selected by the user from among the positionsand displaying the second user interface at the position selected by theuser.
 8. The method of claim 1, wherein, the second user interface isdisplayed on one portion of the screen and overlaps at least a portionof the first user interface such that the at least the portion of thefirst user interface overlapped by the second user interface isincapable of receiving an input from the user.
 9. The method of claim 1,wherein the first user interface and the second user interface aredifferently displayed according to types of the application.
 10. Themethod of claim 1, wherein the first virtual button is one of a buttonfor starting, stopping, and resetting the operation of the image formingapparatus.
 11. A non-transitory computer-readable recording mediumhaving recorded thereon a program for executing the method of claim 1,by using a computer.
 12. An image forming apparatus that provides ascreen for manipulating execution of an application, the image formingapparatus comprising: an image forming unit; an image processor forgenerating a first image signal indicating a first user interface forsetting options to be applied to the execution of the application,generating a second image signal indicating a second user interfacecomprising at least a first virtual button for controlling an operationof the image forming apparatus and a second virtual button forcontrolling another operation of the image forming apparatus, andreceiving a setting of a disappearance adjustment configuration for thesecond user interface, wherein at least one of a function and anappearance of the first virtual button is maintained identicalregardless of the application whose options are set by the first userinterface while at least one of a function and an appearance of thesecond virtual button is changed according to the application whoseoptions are set by the first user interface; and a display fordisplaying, based on the first image signal and the second image signal,the first user interface and the second user interface on the screen,wherein the displaying of the second user interface is further based onthe setting of the disappearance adjustment configuration. wherein thesetting of a disappearance adjustment configuration includes apredetermined time, set by a user, in which the second user interfacebecomes transparent and then completely disappears during thepredetermined time.
 13. The image forming apparatus of claim 12,wherein, if the first user interface and the second user interfaceoverlap each other on the screen, the display displays the second userinterface on the first user interface.
 14. The image forming apparatusof claim 13, wherein a degree of transparency of an entire area or apartial area of the second user interface is greater than a degree oftransparency of the first user interface so that a portion of an area ofthe first user interface that is overlapped by the second userinterface, is visible by the difference between the degrees oftransparencies of the first user interface and the second userinterface.
 15. The image forming apparatus of claim 13, wherein, if amanipulation by the user with respect to the first user interface isinput, the second user interface disappears from the screen, and if themanipulation by the user, with respect to the first user interface,ends, the second user interface is displayed again on the screen. 16.The image forming apparatus of claim 13, wherein, if a manipulation bythe user with respect to the first user interface is input, the seconduser interface is displayed as a substitution icon on an area of thescreen, and if a manipulation by the user with respect to thesubstitution icon is input, the second user interface is displayed againon the screen.
 17. The image forming apparatus of claim 13, wherein thesecond user interface can be moved to a random position on the firstuser interface.
 18. The image forming apparatus of claim 12, wherein,when a manipulation by the user with respect to the second userinterface occurs, the display displays positions to where the seconduser interface can be moved on the screen, moves the second userinterface to a position selected by the user from among the positions,and displays the second user interface at the position selected by theuser.
 19. The image forming apparatus of claim 12, wherein the seconduser interface disappears the predetermined time after an input of amanipulation by the user to the first user interface so that a portionof the first user interface, which was overlapped with the second userinterface before the predetermined time elapsed, is accessible and is ina usable state for manipulation by the user.
 20. The image formingapparatus of claim 12, wherein when the application that is executed isa copy application, the first user interface includes at least onevirtual button for setting options to be applied for copying a document,the options to be set including at least one of a number of copies to bemade, a paper source, a color mode, image attribute adjustment settings,and reduction/enlargement settings, and the first virtual button of thesecond user interface corresponding to the copy application controls theimage forming apparatus to perform one of a reset operation, a startoperation, and a stop operation.
 21. The image forming apparatus ofclaim 20, wherein when the application is changed from executing thecopy application to executing another application, the first userinterface changes such that at least one other virtual button forsetting options to be applied with respect to the another application isdisplayed, and the function of the second virtual button of the seconduser interface is changed so that the second virtual button of thesecond user interface corresponds to the another application andcontrols the image forming apparatus to perform the function.
 22. Animage forming apparatus that provides a screen for manipulatingexecution of an application, the image forming apparatus comprising: animage forming unit; and an image processor to generate a first userinterface for setting options to be applied to the execution of theapplication and a second user interface comprising first and secondvirtual buttons for controlling an operation of the image formingapparatus, and to receive a setting of a disappearance adjustmentconfiguration for the second user interface, wherein at least one of afunction and an appearance of the first virtual button is left identicalregardless of the application whose options are set by the first userinterface while at least one of a function and an appearance of thesecond virtual button is changed according to the application whoseoptions are set by the first user interface; and a display to displaythe first user interface and the second user interface on the screen,wherein the displaying of the second user interface is at least partlybased on the disappearance adjustment configuration, wherein the settingof a disappearance adjustment configuration including a predeterminedtime, set by a user, in which the second user interface becomestransparent and then completely disappears during the predeterminedtime.
 23. The image forming apparatus of claim 22, wherein both thefunction and the appearance of the first virtual button remain identicalregardless of the application being executed by the image formingapparatus.
 24. The image forming apparatus of claim 22, wherein when anew application is selected, the first user interface is configured toset the options to be applied to the execution of the newly selectedapplication and wherein both the function and the appearance of thesecond virtual button are changed to correspond to the newly selectedapplication.
 25. The image forming apparatus of claim 22, wherein when anew application is selected, the first user interface is configured toset the options to be applied to the execution of the newly selectedapplication, and wherein both the function and the appearance of thesecond virtual button are changed to correspond to the newly selectedapplication while the function and the appearance of the first virtualbutton is left unchanged.